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tivity within the Department of Defense (DoD) . To enhance 
these efforts, DPPO requested a study to be conducted to 
determine if methods of risk or uncertainty will affect the 
results obtained by the current procedure. This study 
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and examines their impact on the project rankings. A back- 
ground of DPPO and PIFs is presented together with discussion 
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indicators used in ranking projects. A model is then ex- 
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procedure. Results of the initial comparison and sensitivity 
analysis is revealed. Conclusions are drawn based on these 
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I. 



INTRODUCTION 



A. BACKGROUND 

As early as February 1969, the Department of Defense 
(DoD) began to place emphasis upon increasing efficiency 
and productivity within its department. This was also 
complementary to the overall efforts of the federal govern- 
ment. These efforts led to the creation of the Defense 
Productivity Program (DPP) whose primary objective is "to 
achieve optimum productivity growth (increase the amount 
of goods produced or services rendered in relation to the 
amount of resources expended) throughout DoD" [6: pg. 1]. 

It should be noted that this does not include contractors. 

It is intended solely for DoD and the Service Components. 
Furthermore, this approach called for the development of 
Productivity Enhancing Capital Investments (PECIs) . Responsi- 
bility for the administration of the program was assigned to 
the Assistant Secretary of Defense; Manpower, Reserve Affairs 
and Logistics (ASD (MRA&L) ) who designated his authority to 
the Defense Productivity Program Office (DPPO) . This Office 
acts as the coordinator for the DPP and serves as liaison 
between the Office of the Secretary of Defense (OSD) and 
Service Components in productivity matters. 

One of the problems faced by DPPO in the management of 
PECIs was the process of allocating funds. Due to budget 
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constraints, not all of the recommended productivity projects 
could receive funds. To alleviate this dilemma, projects 
are ranked according to three economic indicators: internal 

rate of return (IRR) ; return on investment (ROI) ; and invest- 
ment per manpower space saved (INVPERSV) . Projects then 
receive funding according to their rank until the budget 
for that fiscal year is exhausted. 

B. STATEMENT OF THE PROBLEM 

DPPO's concern is to ensure that funds are allotted 
to the most productive projects. Considering that projects 
forecast uncertain savings and costs into the future, this 
is an understandable concern. Under the present procedure, 
DPPO can only validate the use of correct discount rates in 
making these predictions. However, the realization of these 
forecasted costs and savings is questionable. The introduc- 
tion of methods involving risk and uncertainty may aid in 
the efficient allocation of funds. The question to be 
addressed in this thesis is whether or not the use of risk 
and uncertainty techniques will significantly change the 
current ranking of projects. 

C. OBJECTIVES OF THE ANALYSIS 

The objectives of this analysis will be to develop a 
model incorporating uncertainty, rank the projects using the 
model, and compare these results to the current ranked list. 
Since the present method ranks projects according to IRR, 
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ROI, and INVPERSV, the model will apply risk factors to these 
areas. The model will not introduce any new variables (e.g., 
net present value, payback period, etc.) which might affect 
the rankings. Furthermore, only those equations used by 
DPPO to calculate economic indicators will be presented in 
the model unless a simpler formula exists that portrays 
identical behavior. This specifically refers to the method 
used to compute IRR. The current method uses average yearly 
savings and the model utilizes constant yearly savings. 
Although the formulas will result in different IRRs, any 
change in savings will result in an equi-proportional change 
in rate of return. 

Additionally, sensitivity analysis will be performed on 
the model. Initial analysis will restrict itself to the 
single variable case and will be expanded later to consider 
multivariable deviations. The purpose of this analysis will 
be to determine the level of change of input variables to 
effect a change in ranking. 

D. CONTENTS 

The following chapter introduces the reader to DPPO and 
the Productivity Investment Fund (PIF) . The background of 
DPPO and its functions, an overview of PECI's, the PIF's 
past funding levels, and procedures used to obtain these 
funds will be addressed. Chapter III will familiarize the 
reader with risk and uncertainty as well as techniques in 
dealing with each. It will further apply the use of 
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uncertainty to the PIF. Chapter IV defines the terms and 
gives a detailed description of the model. It will explain 
how branch values were obtained and discuss the basic 
assumptions of the model. In Chapter V, the ranking derived 
using uncertainty will be compared to the current ranking, 
sensitivity analysis performed, and the results of the analysis 
revealed. Chapter VI will summarize this thesis and present 
conclusions and recommendations derived therefrom. 
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II. DEFENSE PRODUCTIVITY PROGRAM OFFICE (DPPO) 



A. BACKGROUND 

As previously stated, emphasis on productivity and 
efficiency within the Department of Defense (DoD) began 
in 1969. Initial attempts called for the establishment of 
the Defense Economic Analysis Council in October 1972. This 
council served in an advisory capacity to the Assistant 
Secretary of Defense (Comptroller) and encouraged the appli- 
cation of economic analysis and program evaluation in order 
to increase the cost effectiveness of budget proposal inputs 
to the Planning, Programming and Budgeting System (PPBS) . 

In August 1975, DoD Directive 5010.31 established the De- 
fense Productivity Program. The primary objective of the 
program is "to achieve optimum productivity growth (increase 
the amount of goods produced or services rendered in relation 
to the amount of resources expended) throughout DoD" [6: 
pg. 1] . This directive required Defense organizations to 
be both effective and efficient in the utilization of all 
types of fund resources (operating and investment) as well 
as labor resources. Furthermore, the directive identified 
productivity measurement, productivity enhancement, and 
productivity evaluation as key elements to the program. 
Although all three elements play important roles in the 
program's success, only Productivity Enhancement (PE) will 
be discussed in this paper. 
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In 1979 DoD Directive 5010.31 was reissued, forming the 
Defense Productivity Program Office (DPPO) which had over- 
all responsibility of the Defense Productivity Program (DDP) . 
DPPO was placed under the cognizance of the Assistant Secre- 
tary of Defense (Manpower, Reserve Affairs and Logistics) 
(ASD, MR&L) in 1981. 

The DPP to be developed would include a planned approach 
to PE including, but not limited to, the development of 
Productivity Enhancing Capital Investment (PECI) programs. 
PECIs are classified as: 

1. Office of the Secretary of Defense (OSD) sponsored 
projects; 

2. Industrial Fund Fast Payback (IFFP) projects; and 

3. Other Component Sponsored Investment (CSI) projects. 

OSD sponsored projects include the following categories: 

a. Productivity Enhancing Incentive Fund (PEIF) projects. 
These projects are 

...fast payback PECI projects financed from drawing 
accounts established within annual appropriations . 

These projects cannot exceed $100,000 or cost 
limitations established by OSD (whichever is 
greater) and must amortize within 2 years of 
the date they become operational. [7: pg. 4] 

b. Productivity Investment Fund (PIF) projects. 

These are projects that have been 

...competitively selected by OSD from candidate 
proposals submitted by DoD Components and financed 
through traditional budget appropriation processes 
from funds set aside by OSD for this purpose. 

PIF projects must be expected to amortize within 
4 years of the date they become operational. 

[7: pg. 4] 
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Since this thesis will deal only with PIF projects, discussion 
on PEIF, IFFP and CSI projects will be omitted. However, 

PIF funding levels and procedures will be of interest later 
and will be the next topic. 



B. PRODUCTIVITY INVESTMENT FUND (PIF) FUNDING LEVELS 

To better understand the magnitude of these investments, 
a look at past and proposed funding levels may prove bene- 
ficial. The first PIFs were funded in 1981. Money for the 
program was $105 million that year and $110 million for 1982. 
David Whipple and Jack LaPatra [15] completed an evaluation 
of DPPO's activities revealing. 

The average cost of PIFs has been $2 million, with 
an average payback of 2.5 years. Having an average 
lifetime investment of $11.2 million, they are 
expected to return $6 for $1 invested. Approximately 
$700 million has been requested under PIF by all 
services for FY 83-87. [15: pg. V-15] 

The average cost of proposed projects for FY84 budgeting is 

approximately $1.6 million, slightly less than previous 

years . How a Service Component proceeds to obtain funding 

for a productivity project is the next topic. 



C. PIF FUNDING PROCEDURE 

Department of Defense Instruction (DoDI) 5010.36 estab- 
lishes policy and prescribes procedures for the Productivity 
Enhancing Capital Investment (PECI) program with which the 
PIF is affiliated. Excerpts from this directive concerning 
policy indicate the intent of the program by stating, "PECI 
funding procedures focus upon financing those projects that 
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substitute capital for labor" [7: pg. 2]. In yet another 

section, guidelines for project selection is delineated, 

Top priority will be given to those potential invest- 
ments that amortize in the shortest period of time 
and those with the highest potential internal 
rate of return on investment or the highest net 
present value. [7: pg. 2] 

Furthermore, the instruction dictates a specific format for 
DoD Components to follow when requesting money for produc- 
tivity projects. A copy of the format is contained in 
Reference 7. Some of the required information that will 
be of particular interest later includes total cost, total 
savings, internal rate of return (IRR) , savings to investment 
ratio, rate of investment per manpower space and cost-benefit 
streams. These concepts are explicitly defined and evaluated 
in Chapter IV below. From this base, net present value (NPV) 
and payback period (P-P) can be calculated and economic 
analysis performed. For purposes of uniformity, the term 
savings to investment ratio is synonymous with return on 
investment (ROI) . 

The sequence of events from project initiation to project 
funding may be outlined as follows: 

1. A DoD Component prepares an initial proposal for a 
project categorized as a PIF using the format af DoDI 
5010.36. 

2. This proposal is forwarded via the appropriate chain 
of command for approval. 

3. Each service then compiles a list of the "best" proj- 
ects, normally in rank order, that meets its needs and objectives. 
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4. These lists are then forwarded to DPPO who conducts 
an economic screen. The screening process consists of 
recomputing the information and checking the accuracy of 
each proposal in terms of calculations and validity of 
pro j ections . 

5. The projects are separated according to function, 
i.e., Automatic Data Processing (ADP) , aircraft maintenance, 
etc., and forwarded to the appropriate Office of the Secre- 
tary of Defense (OSD) Functional Manager for a final screening. 

6. Projects are returned to DPPO who computes a final 

ranking of all approved projects. This ranking is based on 
three key indicators: IRR, ROI and Investment Per Manpower 

Space Saved (INVPERSV) . Each indicator receives equal weight 
with ties in rank going to the project with the highest IRR. 

7. From the current budget set aside for PIF projects, 
all out-year funding on prior approved projects is deducted, 
i.e., a FY81 project requiring funds for two years receives 
its FY82 money from the FY82 budget. A running cumulative 
sum of investment costs on currently approved projects is 
performed and the balance of PIF monies allotted. It should 
be noted that not all projects approved will be funded. 

8. DPPO then issues a Program Budget Decision (PBD) to 
the services who, in turn, add this money to their respective 
Service Budget requests. 

9. Once Congressional approval is received, as it usually 
is, the funds are appropriated accordingly. This entire 
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cycle takes approximately 1 year to complete and any project 
not funded that year may reapply the following year. 

At this point, the reader should have a basic understand- 
ing of DPPO, PIF and the procedures used to obtain project 
funding. What may not be so clear is the role that risk 
and uncertainty play. The next chapter attempts to intro- 
duce these terms and relate them to the PIF. 
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III. RISK AND UNCERTAINTY 



A. INTRODUCTION 

The word decision may be defined as a choice among 
alternatives. In any investment, a decision may be made 
under conditions of certainty, risk, or uncertainty. Cer- 
tainty postulates that the decision maker knows in advance 
all parameter values that will affect the decision. With 
risk, he is aware of all future states that will affect his 
decision and can place a probability distribution on the 
value of the occurrence of each state, i.e., the probability 
distribution which describes possible outcomes is known. 
According to Morris [13] , uncertainty implies that a decision 
maker may or may not be aware of all possible states and may 
or may not be able to place a probability distribution on the 
occurrence of each. 

Figure 1 depicts a decision problem represented by a 

payoff matrix. Here, the columns, s^ , S 2 / • • • r s n , represent 

future states of nature and the rows a., a-...., a are the 

12 m 

alternatives. The P^^'s, where i = l,2,...,m and j = l,2,...,n, 
represent the payoff of alternative i in state j . If a 
probability distribution can be placed on the states of 
nature, then Morris [12] , Fishburn [8] , Luce [10] and Savage 
[14], give several principles that may be used to aid in 
decision making. These principles, expectation, most probable 
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Figure 1. Typical Payoff Matrix 

future, expectation-variance, and aspiration level, will be 
discussed in detail in Chapter IV. If the decision is made 
under uncertainty, then the Laplace Principle, minimiax or 
maximin, minimin or maximax, Savage's minimax regret, and 
the Hurwicz principle are common principles of choice. 

Clark, et al [4] explain another technique in dealing 
with risk and uncertainty known as Utility Theory. This 
is an attempt to formalize rational decision making. In 
this approach, preferences among alternatives are specified 
by the decision maker. The utility value attached to the 
various alternatives then represent all aspects that are 
relevant to the decision. 

If a decision maker perceives different levels of risk 
associated with the future states, then the Certainty 
Equivalent Method may prove useful. This approach permits 
adjustment for risk by incorporating the decision maker’s 
utility preference for risk. In an economic scenario, it 
is reasonable to assume that estimates of cash flows are 
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likely to be more accurate during the early periods of an 
investment than in the later years. Subsequently, the risk 
should be adjusted to reflect this. In dealing with simi- 
lar situations, whether economic or not, the certainty 
equivalent method may be preferred. 

Raiffa [13] explains a popular decision technique known 
as a decision flow diagram or "tree.” Here, a manager has 
several courses of action he may take. For each course of 
action, there may be several consequences associated with 
it. Furthermore, with each consequence there exists a 
probability of that event occurring. Figure 2 depicts a 
simple example of a decision tree. In this example, a deci- 
sion maker has a choice of investing $15,000 on a project. 




-$ 10,000 

$20,000 

$60,000 



Figure 2. A Simple Decision Tree 

If he decides not to invest, he gains or loses nothing. If 
he invests, then the project will be unsuccessful with 
probability 0.2, marginally successful with probability of 
0.5 or highly successful with probability 0.3. In this 
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particular case the decision maker faces an 80 percent chance 
of a successful project. Taking this one step further, the 
principle of expectation or expected value can be used. 
Mathematically, expected value, R is 



R 



N 



i=l 



R.P. 
1 x 



( 1 ) 



where : 

R is expected value, 

R. is the value of the ith outcome, 
i ' 

P^ is the probability the ith outcome occurs, 

N is the total number of outcomes. 

Applying this to the decision tree yields 

R = (-$10,000 x 0.2) + ($20,000 x 0.5) + ($60,000 x 0.3) 

= $26,000. 

Depending upon the decision maker's risk posture, i.e., the 
minimum return he will accept on this investment, he may or 
may not invest . 

It should be noted that the probabilities associated with 
the occurrence of consequences may not be very easy to obtain. 
When reviewing the available courses of action, the decision 
maker always has the option of delaying a decision until 
further data can be gathered which might provide insight 
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into the results of the various choices. However, delaying 
a decision usually has an associated cost. This cost may 
be in terms of time, money, workforce or numerous other 
things. According to Mooney [11], significant in this area 
are the benefits derived from increased information and the 
increase in certainty as a function of time. Figures 3 and 
4 graphically illustrate this problem. 

The dilemma of determining how much information is cost 
effective can often be viewed as a problem itself. How one 
obtains information can help in reducing costs. If data is 
readily available, the tools of regression, data analysis, 
non-parametric statistics and probability theory can be use- 
ful in providing a structured solution. On the other hand, 
if facts must be gathered, then other techniques may be 
used as well. Moody [11] suggests several non-mathematical 
means available including consensus thinking, brainstorming, 
the delphi principle, fish bowling, didactic interaction and 
collective bargaining. In addition to the above, other methods 
such as PERT (Program Evaluation and Review Technique) and 
QUID (Quantified Intrapersonal Decision Making) are becoming 
readily accessible. 

B. APPLICATION OF RISK AND UNCERTAINTY TO THE PIF 

During the funding process for Productivity Investment 
Funds (PIF) , each project is checked for accuracy in its 
projections. -Components requesting funds review and analyze 
past data on costs, workloads, etc., in an attempt to forecast 
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Uncertainty and cost of Costs and benefits 

gathering data increase increase 



A 



Cost of 




Figure 3 Cost-Benefit Time Curve 




Figure 4 Cost-Uncertainty Time Curves 
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costs and savings into the future. These savings are the 
key to calculating such indicators as internal rate of return 
(IRR) , return on investment (ROI) , and investment per man- 
power space saved (INVPERSV) . However cautious and meticu- 
lous an analyst or manager may be, these savings may or may 
not be realized. Techniques of risk and uncertainty may 
aid in taking futuristic inputs into account and better 
predicting savings. An example might best portray this 
statement . 

Consider a machine that extracts rivets from aircraft 
wings at a rework facility. The investment cost of the 
machine is $60,000. Since the cost incurred is in the very 
near future, it will be assumed to be accurate (providing 
installation costs, transportation costs, etc., have been 
incorporated) . In the cost-benefit stream, savings are 
forecast to be $30,000 per year for 10 years. Furthermore, 
assume the projected savings were based on a constant work- 
load, that of the current level, throughout the economic 
life of the machine, i.e., 10 years. Clearly such factors 
as war, depression or recession, the introduction of a low 
maintenance aircraft, etc., could substantially increase 
or decrease the workload of the facility and, hence, pro- 
jected savings. The list of factors that could affect the 
projections is practically endless. To construct a model 
incorporating all of these factors would be tedious and costly, 
with the model becoming unmanageable. If risk and uncertainty 
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were used on a macro level, most of these problems would be 



alleviated. (The word macro is used here to distinguish the 
analysis from a micro aspect.) The micro aspect of analysis 
would consider each factor, to achieve the final result. In 
the macro sense, one is concerned only with whether or not 
realized savings were above, below, or as projected without 
concern for the factors that would cause it to deviate. The 
macro model could enhance managability and still yield 
workable results, especially if not one, but 50 to 100 projects 
had to be dealt with. 

The impact of risk and uncertainty in dealing with PIF 
projects should be apparent. The methodology and model used 
toward this end is presented in following chapters. It 
should be noted that the procedure used is not exclusive to 
investments alone, nor is it the only method applicable for 
analysis. Variations on this theme will also be mentioned 
later. 
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IV. AN ECONOMIC MODEL 



A. DEFINITIONS 

The underlying motive of any business is to make a profit. 
One method of achieving this is through capital investments. 

It follows that managers expect money invested today to in- 
crease in amount as time passes because they expect to earn 
a profit on that investment. To the manager, therefore, the 
value of money today is more than its value at some future 
time. Anthony and Reese [1] make an interesting analogy, 

"An investment is thus the purchase of a future stream of 
expected cash inflows" [ 2 : pg. 710], Cash inflows are simply 
earnings or savings . 

If several investment alternatives exist, then a basic 
criterion must be established for the purposes of comparison 
and evaluation. Although five criteria are explained next, 
only three (IRR, ROI, INVPERSV) are used by DPPO. 

The first economic indicator. Net Present Value (NPV). , 
is the difference in the present value of the benefits 
(savings) and the present value of the costs at a given 
discount rate (the interest rate used to discount or calcu- 
late future costs and benefits so as to arrive at their 
present values). Mathematically, this may be expressed as: 



NPV 



n S 

l — - 

t=l U + k) 



t A 0 



(21 
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where 



Aq = present value of the cost of the project, 

S t = savings received in period t, 

k = appropriate discount rate, 

t = time period, and 

n = useful life of asset. 

If Aq is incurred over a period of time, then 



n A^ 

- 2 h- , 

u t=l (1 +kl r 



( 3 ) 



where A fc is the cost during period t. If the NPV is posi- 
tive, it means the project is expected to yield a return in 
excess of the required rate. If it is zero, the yield is 
expected to equal the required rate. 

The discount rate that equates the present value of 
the future cash flows with the present value costs of an 
investment is known as the Internal Rate of Return (IRR) . 
This is calculated by determining the discount rate that 
will make the NPV zero: 



n 



l 

t=l 



Cl +r) 



0 



( 4 ) 



where : 

r = IRR, 

S t = savings received in period t. 
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t 



time period 



A, 



0 



investment cost, and 



n 



useful life of asset 



If cash inflows are uneven, the trial and error method is 
recommended. Computers ease the tediousness of the compu- 
tation; however, DoD has derived a more simplistic procedure. 
Dividing the project cost by the average annual savings will 
yield a factor. This factor and the number of years in the 
economic life of the project can be used to enter a table 
and select the IRR. If the cash inflows are even, Anthony 
and Reese [1] , using the same calculation, offer the IRR 
based upon the same table inputs. 

The Payback Period (P-P) refers to the number of periods 
required for the (undiscounted) cumulative cash inflows to 
have the same value as the investment cost. 

Another indicator. Return On Investment (ROI) , is synony- 
mous with the savings to investment ratio. This method com- 
pares yearly income of a project with the investment in the 
asset [1; pg. 52]. The formula used by DPPO is: 



n 



I S 

t=l 



(5) 




where : 



S 



t 



savings received in period t 
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C t = costs incurred in period t 
t = time period 

n = useful life of the asset. 

Finally, the Investment Per Manpower Space Saved 
( INVPERSV) is simply an indicator that compares cost to 
manpower. A manpower space is best defined by example. 

If two clerks are required to perform a task, and the 
introduction of a new system requires only one of them, 
then the other is freed and can be assigned elsewhere. This 
equates to saving one manpower space . 

B . THE MODEL 

Although the techniques of both risk and uncertainty 
have been discussed, the model that will be presented next 
will deal strictly with uncertainty. This is not tq say 
that the model could not be used with risk. After careful 
analyses of several dudit reports, there was not enough inf or- 
mat ion to derive probability distributions, thus eliminating 
the introduction of risk. In particular, the audit reports, 
for the most part, failed to compare actual (or realized) 
costs or savings to that which was proposed. Without this 
information, it would be extremely difficult to obtain proba- 
bility distributions (the use of subjective probabilities 
could have been used) . Further discussion on this point is 
contained in Chapter VI . 

In the process of evaluating and ranking PIF projects, 

DPPO used three indicators; IRR, ROI and INVPERSV. The 
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model, therefore, will contain three submodels used to 
evaluate each indicator respectively. A tree diagram was 
used in each submodel in order to present the different 
outcomes in an orderly fashion. Figures (5), (6) and (7) 

are graphical representations of these models. The under- 
lying assumption used in the development of each diagram is 
based on the independence of cost, savings, manpower space 
saved (MPS) and cash flow. The term independence is used 
to signify that an outcome of one variable is not dependent 
on any of the others. This assumption allows one to branch 
out the different future states of nature and then apply 
uncertainty techniques. 

It should be noted that the IRR model utilizes one branch 
instead of two as represented in the other models. This was 
done for two reasons. The first is that Sciortino's [1] 
audit of FASCAPs (Fast-Payback Capital Investments) revealed 
that 11.7 percent of all funded projects resulted in cost 
overruns of 10 percent of the total projected cost. This 
sum did not appear to be significant in comparison to the 
total cost of all of the funded projects. Secondly, the 
program used to evaluate the model was written in APL (A Pro- 
gramming Language) . The IRR computation was derived through 
an iterative loop which, in APL, can be costly due to the 
limitations of APL's capabilities (one run of 15 projects 
takes approximately 10 minutes, equating to a cost of nearly 
$80.00) . Comparing the cost of computation to the benefits 
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Figure 6 . ROI Submodel 
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Figure 7 . IRR Submodel 



derived from the additional branching, it was felt that one 
branch was adequate. 

As previously stated, the main model was broken down 
into three submodels, one for each indicator to be ranked. 

Once the program has computed the branch values in each 
submodel, it proceeds to apply the techniques that deal with 
uncertainty, in particular, the MAXIMIN, MAXIMAX and LaPlace 
principles . 

The MAXIMIN principle may be viewed as a pessimistic 
approach. This principle of choice suggests that the maxi- 
mum of the minimum gains be chosen, or select the best of 
the worst outcomes. In this section of the program, the 
minimum value of each submodel is selected and stored in three 
vectors (one for each indicator) . These vectors are then 
placed in a 47^ by 3 matrix where the rows represent projects 
and the columns are the respective indicators. A value in 
the matrix is the minimum value for an indicator peculiar to 
a project. Once this matrix is complete, each column (or 
indicator) is ranked from highest to lowest (i.e., the great- 
est number receives rank one, and so onl . In the event of 
a tie, an average rank is used. These rankings are then 
placed in another matrix which will be referred to as the 
rank matrix. The ranks are then summed across the columns 
(indicators) and then re-ranked from lowest to highest. 

By summing across the columns, one is merely adding the ranks 

^There are 47 PIF projects funded in FY84. These 
projects form the data base. 
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of the indicators for each project. Subsequently, the 
project with the lowest combined rank is the best project 
and hence the reason to rank from the lowest (rank one) to 
the highest. The result of this procedure is a vector of 
47 elements (one for each project) representing the final 
ranking . 

The second technique used is the MAXIMAX principle. 

This is an optimistic approach where the best possible out- 
come is maximized. The procedure used here is identical 
to the MAXIMIN computation with the exception that the maxi- 
mum value in each submodel is chosen instead of the minimum. 

The LaPlace principle is computed somewhat differently. 
This method assumes that the branch values are equally likely 
to occur within each submodel. Using this probability dis- 
tribution, an expected value for each indicator can be de- 
rived. The result is a matrix of expected values for each 
project and indicator. This matrix is then ranked using 
the same procedure as previously discussed. 

The ultimate product of the program is a matrix of the 
final rankings of each product using each of the three 
methods of uncertainty. It is now possible to judge the 
effect of uncertainty by comparing these rankings to those 
derived using DPPO's procedure. However, before these 
results are revealed, some discussion on software support 
for the model and problems that arose during the develop- 
ment of the model warrant attention. 
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C. SOFTWARE SUPPORT 



In the process of evaluating the model, two data files 
were created and several functions and programs written. 

The first file, THESISD, is a 47 x 5 matrix where the rows 
represent the projects and the columns are total cost, total 
savings, manpower spaces saved, NPV, and economic life. 
CFMATRIX is the second file containing the cash flows for 
each project over a period of 28 years. To ensure matrix 
conformability , zeroes had to be added to those projects 
whose economic lives were less than 28 years. These zeroes 
are removed in the main program to reduce computations. 

The main program, UNCERT, is written in APL and calls 
its data from the two files. It internally computes ROI 
and INVPERSV branch values, selects max and min values and 
calls other functions for IRR values (CALIRR) and to perform 
rankings (RANKUP, RANKDN) . A listing of UNCERT as well as 
the functions are contained in Appendix (A) . Copies of the 
base data composes Appendix (B) . 

D . PROBLEM AREAS 

In the development and documentation of the model , 
several problems were encountered which substantially altered 
the procedure to be used. 

The first difficulty concerned itself with the INVPERSV 
computation. The formula used by DPPO can be expressed as 

INVPERSV = Manpower spaces Saved (MPS) * 
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This presents two problems. First, if MPS is zero, INVPERSV 
is undefined (an MPS of zero is not uncommon) . To correct 
this deficiency, DPPO arbitrarily sets INVPERSV equal to 
9999.99. Secondly, if MPS is between zero and 1, then 
INVPERSV is greater than the total cost. Currently, there 
is no correction for this. Another difficulty with this 
indicator lies in its lack of logical attractiveness. Ex- 
plicitly, IRR and ROI are benefits which implies bigger is 
better. INVPERSV, as presently used, is a cost (bigger is 
bad) . Although the procedure used by DPPO takes this into 
account, it is felt that the indicator contradicts the logi- 
cal flow when used with the other indicators. 

A second problem arose when trying to duplicate DPPO's 
calculations of IRR. Using Equation (4) and assuming the 
cash inflows were present value (verified by DPPO to be 
correct), the IRR's obtained from CALIRR differed from those 
calculated by DPPO. 

Another minor discrepancy involved the value for economic 
life. THESISD contained one value, however, when calculating 
IRR, different economic lives were obtained using the cash 
inflow information. This had no effect on calculations 
since IRR used strictly cash flow information. 

Concern was additionally raised due to the fact that 
DPPO's final ranking could not be reproduced. Further dis- 
cussions on this point are unnecessary since modifications 
to the analysis to be performed would create new rankings, 
thus eliminating any reason to duplicate the original ranked list. 
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E. PROCEDURE 



At this point the reader should have an understanding 
of the model, how uncertainty will be introduced, and some 
problems that were encountered in the process. This section 
will: a) discuss how the INVPERSV problem was solved, 

b) explain how deviation levels were obtained, c) how the 
IRR confusion was treated and d) given an outline for 
sensitivity analysis that will be performed. 

The first topic is how to correct the INVPERSV problem. 

If the original indicator yielded a cost, then the inverse 
of the indicator would be a benefit. Additionally, the in- 
verse would also alleviate the problem of dividing by zero 
or a fraction. However, the inversion of the indicator re- 
sults in a decimal. By scaling the result (multiply by 1000) , 
the indicator becomes more readable and comparable to the 
other indicators. This transformation is given by: 



INVPERSV 



, Total Manpower Spaces Saved N ^ lnrir> 
1 Total Cost 1 1000 



(7) 



Take, for example, an INVPERSV of 275.0. The inverse would 
be 0.0036. Scaling by 1000 yields 3.6. Several things 
should be noted. First, using a scalar of 1000 is purely 
arbitrary. Any scalar could have been used. Secondly, by 
inverting the indicator, the ranking must be done from high- 
est to lowest. This did not change the original ranking 
done by DPPO. The final point is that by inverting, the 
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logical attractiveness of INVPERSV is achieved. The reason 
for scaling is discussed more in Chapter VI but deals with 
an alternate means of obtaining a ranking. 

In Section C, the idea of changing different variables 
(i.e., cost, savings, etc.) was introduced. How much to 
vary these variables is what is of interest here. In the 
program, deviation levels are represented as a vector with 
three elements. These elements represent variables above 
the projected level, as projected, and below projected 
levels. That is to say, if a cost overrun were to occur, 
the average overrun would be, for example, 20 percent of 
the projected cost. This can be mathematically expressed 
as, cost overrun = 1.2 * projected cost. Similarly, to main- 
tain the projected cost, a multiplier of 1 is used while a 
number less than 1 would relate a cost underrun. Deviation 
levels can be determined by 



Cost Deviation 



Actual Cost 
Projected Cost ’ 



( 8 ) 



By using Sciortino's [1] audit and Equation (8), deviation 
levels for cost, savings, and cash flows were obtained. Man- 
power variations, however, were purely subjective. In 
reviewing several audit reports, there is no data to address 
this point. The deviation levels used to obtain variations 
were 1 . 1 for a manpower overrun and 0 . 9 for an underrun . The 
sensitivity analysis that will be performed later will further 
address this area. 
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IRR fluctuations created an area of concern since they 
could not be duplicated and since the results obtained using 
Equation (4) showed no correlation to DPPO's data. To 
remedy the situation, all 47 projects were ranked using 
Equation (4) to calculate IRR and Equation (7) for INVPERSV 
(ROI calculations were the same) . The results of this run 
will be referred to as the DPPO Base since this is what the 
rankings should have been with all problems aside. Next, 
a run was made to introduce uncertainty. These results were 
compared to the DPPO Base to see if any significant changes 
had taken place. For reference. Appendix (C) is the DPPO 
Base case and Appendix (D) displays the results after uncer- 
tainty was applied. 

In order to examine which variables and uncertainty 
methods were critical, sensitivity analysis was performed. 

The variables of concern are cost, savings and manpower spaces 
saved. Initially, single variables were used, followed by 
changes in two variables and finally, by three. Appendix (E) 
contains the results of these runs while the next chapter 
discusses this issue in greater detail. 
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V. RESULTS 



A. INITIAL COMPARISON 

DPPO ' s ranking was computed using the new INVPERSV and 
IRR ranking. The base case, which introduces uncertainty 
into the ranking, was run using deviation levels outlined 
in Table I. These values were obtained using Sciortino's 
[1] audit and Equation (8) . The output of the two runs were 
then compared to determine if the base case had any impact 
on DPPO's ranking. 



TABLE I 

Deviation Levels Used in the Base Case 



Above 

Projected 



Below 

Projected 



Cost 1.256 



0.825 



Savings/ 

Cash Flows 1.014 0.3116 



Manpower 

Spaces 1.1 0.9 



Before any comparison may be undertaken, it might be 
beneficial to define how this impact is to be measured. Three 
terms are used to judge the magnitude of difference between 
DPPO's ranking and the base case; 1) significant (S) implies 
that 5 or more projects experienced any rank jumps or any 



42 



two projects had jumps of 5 ranks or more, 2) slightly 
significant (SS) is defined as 3 or more projects had rank 
jumps or any two projects had j lamps of three ranks or more, 
and 3) no significance (NS) merely represents any situation 
less than those described above. 

Initially, all 47 projects were compared. This revealed 
that the MAXIMIN and LaPlace Principles significantly changed 
the rankings while the MAXIMAX showed little to no change. 
DPPO's rankings were divided into three groups; projects ,1 
through 15, 16 through 31 and 32 through 47. The reason for 
subdividing was to observe where the jumps in ranking 
occurred. A summary of the results is contained in Table II. 



TABLE II 

Summary of Initial Comparison 



Project 

Number 


MAXIMIN 


LaPlace 


MAXIMAX 


All 


S 


S 


NS 


1-15 


SS 


NS 


NS 


16-31 


s 


SS 


NS 


32-4 7 


s 


s 


NS 


Using this 


information, it is 


evident that jumps 


occur more 



frequently in the lower projects. The reason for this 
occurrence is primarily due to the first 15 projects offering 
significantly greater IRRs, ROIs, and INVPERSVs than the 
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others. This information will play a role in performing 
sensitivity analysis and therefore the discussion will be 
delayed until then. 

B. SENSITIVITY ANALYSIS 

Due to cost constraints in running all 47 projects, 
only the first 15 were used to perform sensitivity analysis. 

To begin, a new base case dealing with uncertainty was derived 
and would be used to compare 24 variant runs. The purpose 
of this analysis was to determine which variables were 
critical and which uncertainty methods were sensitive to 
the changes. First, single variable deviations were analyzed, 
followed by two and three variable combinations. 

The results of the initial runs with single variables 
indicated that all three methods were insensitive to minor 
changes in the variables with one exception. This run dealt 
with increasing the bounds (above projected and below pro- 
jected deviation levels) of savings by 20 percent and creating 
significant rank jumps in the MAXIMIN ranking and slightly 
significant jumps in that of LaPlace. 

The deviation levels were then preset to values outlined 
in Table III. It should be noted that these levels are 
substantial deviations from the projected values. This is 
primarily due to the nature of the first 15 projects. As 
mentioned in Section A of this chapter, the initial compari- 
son noted little change in ranking among the three methods. 
This is attributable to the large variations in each of the 
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TABLE III 



Deviation Levels 


Used in Sensitivity Analysis 


Above 


; Projected 


Below Projected 


Cost 


2.512 


CM 

• 

O 


Savings/ 


Cash Flows 


o 

• 

CM 


0.1 


Manpower Spaces 


2.2 


0.2 



variables in the first 15 projects as compared to the rest. 
These variations are presented in Table IV. Due to restric- 
tions in programming, other projects could not have been 
selectively chosen without redrafting files. However, despite 
this problem, it is still possible to determine critical 
variables and sensitive methods. 

Table V conveniently summarizes the results obtained from 
the analysis. A word on notation though, might aid in its 
understanding. In the description column, the variable being 
changed is described as being either high or low. High refers 
to an increase in the above projected deviation level only 
while low, decreases the below projected level. Run 2b 
decreased both bounds by a set percent and Run 3b increased 
both bounds . As stated earlier, other runs utilizing this 
procedure yielded no changes with the exception of 3b and, 
therefore, eliminated further use of the procedure. 

To further summarize the contents of Table V, it can 
be said that the LaPlace principle was the most sensitive to 
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Statistical Summary of Projects 
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Summary of Sensitivity Analysis 
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change. This may be attributed to the cost-savings rela- 
tionship and, in particular, savings deviations. This would 
affect both the ROI and IRR. The method was insensitive to 
manpower variations. The only other method to show a reac- 
tion was MAXIMIN. This is strongly evident in low savings 
cases. Low savings (implying low cash flows) will, in turn, 
drive IRR with an additional effect on ROI. Once again, 
manpower fluctuations had little to no effect. The last 
principle, MAXIMAX showed little to no change during the 
course of the analysis. 

To summarize, the LaPlace principle showed sensitivity 
to more variables or combinations thereof. The MAXIMIN 
method was the only technique to cause significant jumps 
in rankings. With both methods, savings seemed to be the 
critical variable indicating that IRR is the main driver in 
the rankings, followed by ROI. INVPERSV had little to no 
effect in the rankings . 
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VI. CONCLUSIONS AND REMARKS 



A. CONCLUSIONS 

Since the objective of this thesis was to determine if 
the methods of risk and uncertainty could change project 
rankings from the present procedure, this point shall be 
addressed first. It is apparent that both the MAXIMIN and 
LaPlace principles will change the ranking and their incor- 
poration into the present procedure should be investigated 
as a short term solution. Additionally, the LaPlace approach 
is recommended above the others for several reasons: It is 

not an extreme selection; it makes more use of the different 
outcomes than the other methods; and it is more sensitive 
to the variables and combinations thereof. 

This paper does not purport to advocate strict adherence 
to methods of uncertainty in decision making. The use of 
risk is a better solution to solving problems of this nature. 
To enable the use of risk techniques, it is recommended 
that audit reports compare realized costs, savings, and 
manpower to that which was projected. Furthermore, since 
DPPO maintains a data base from which the projects are ranked, 
this data base should also serve as a reference in doing 
audits. As mentioned before, audit reports should also 
address manpower spaces, which to this point, has gone 
without remark . 
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The use of the new INVPERSV and IRR equation have been 
discussed sufficiently. Their incorporation into the 
present procedure is highly recommended. 

The use of equal weights for the indicators is another 
questionable area, and will be addressed in the final section 
of this chapter. 

Although more conclusions could be drawn, the next 
section will introduce a corrective procedure which would 
provide better and more accurate rankings. 

B . REMARKS 

The content of this thesis introduced the use of risk 
and uncertainty into DPPO's procedure. This is what it was 
commissioned to do; however, a better approach utilizing 
multiattribute utility theory may prove to provide quite 
different results. 

The present procedure has several flaws. The first is 
using linear combinations of rankings to obtain a final 
aggregate ranking. Economic indicators are measures of 
effectiveness (MOEs) . These MOEs have a common origin 
(zero) and are measured on a ratio scale, meaning a state- 
ment may be made to the effect that one IRR is twice as 
good as another IRR. 

The use of ranks, changes the scale to ordinal and this 
information is lost. An example may best illustrate this 
point. Suppose a comparison of projects A and B is to be 
made. Project A has an IRR of 200 percent, an ROI of 87 
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percent and an INVPERSV of 78. Project B, on the other 
hand, has an IRR of 25 percent, an ROI of 88 percent and 
an INVPERSV of 79 . According to the present procedure , 
project B is better. However, if a ratio scale is used, 
then project A would be the wiser choice since A's IRR 
is 8 times greater than B's with the other indicators about 
equal . 

Additionally, the sensitivity analysis pointed out that 
IRR seemed to drive the rankings with ROI having a smaller 
input. This indicates that the use of equal weights may 
not be as reasonable as initially thought. 

This topic should be considered an area for future study. 
The benefits derived from it could be substantial and lead 
to a more effective manner to judge projects and eventually 
realize their benefits. 



51 



APPENDIX A 



This 


SOFTWARE SUPPORT 

appendix contains the programs used to introduce 



uncertainty to the Productivity Investment Fund. 
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C59; 
,60 
61 
162; 
.63. 
"64‘ 
C65; 
Z66 . 
C67; 
68 
69! 



ft 

ft 

ft 



v LINGER T 

'RUN NUMBER: DPPO BASE ' 
INPUT DEVIATION LEVELS 



COST 1)^*1 
SAVDH 
CFDM 
MPSDt-1 

'DEVIATION LEVELS: 



' COST 
' SAVINGS 
' MANPOWER 
■ CASHFLOWS 

I t 



7C0STD 
■ , TSAVD 
■ , TMPSD 

■ , tcfd 



□ 1 INPUT TOTAL NO OF PROJECTS TO BE RANKED* ' 

TN<-0 

I<-0 

MAXIRR*-hAXROI*-hAXMPSH.ROI*-LMPS*-©x i l TN) 
MINIRRt-MINR0I<-MINMPS*-9999x 1 +0* l TN 
L.IRR*-LROI<-LMPSr-©x ).TN 
LI : I<-I + 1 
ft INSERT DATA 
COSTt- . THESISDT I ; 1 ] 

' 1 : 2 " 



SA'v> , THESISD 
MPSt-, THESISD 



NPV*-. THESISD [I ; 4] 



CF<- , CFMATRIX 



: I ; 3 






PROJECT NUMBER: MI 



TOTAL COST 
TOTAL SAVINGS 
MANPOWER SAVED 



' , TCOST 
' , TSAV 
1 . TMPS 



DELETE 0‘S FROM CF VECTOR 
: ' , TCF 



CFt-DROP CF 
' CASH FLOWS 

I l 



» COMPUTE BRANCH VALUES 

COSTS<-COST xCOSTD 
SAVS<-SAVxSAVD 
MPSSr-MPSxMPSD 
COUNTi-pCOSTS 

» SELECT THE VALUES FOR EACH OF THE PROJECTS 
' ROI MPS' 



EROI *-EMPS«-Ox l 9 
J<-L«-0 
L2 : J*J+i 
K<-0 

L3 : l<H< H 
L<-L+1 



EROITL 

EMPSlL 

EROIfL 



«-sAvsrj]-rCosTsrK] 

■: mess r ji+cos ts ckd x i ooo 

AND EMPSCL] 



ft 

ft 

ft 



•»(K< COUNT )/L3 
-K J< COUNT >/L2 

COMPUTE IRR VALUES 
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—k_4-.-j-.-k — k— k—k-k—k_*. —k._k — k— u— k_jh— v— k— k_j — >- 'O'-O-O "O^O ^<0 <! 'O " 0 'O 00 02 00 CC< 00 CO 00 CO 00 GO -vi -si -vJ J **vi *^J -vj - nJ-vJ -^J 

rorororj^^^^^^ •^^^^^oooooooooo^o^-jcr-iji^cKiro^Ovooo-.jCh^-^CKjro-^ONOCO-vjcr^-tuf o-^o 
-t-CKi^j^o>o cc* j o* i^n -fc^ o^i ro o <i co - nj o- r- j c^u-juj^', > .>» t_ii *,.s l_j 



i 



CALIRR CF 



ft APPLY LAPLACE METHOD 



LRGim<-LAPLACE 



LMPSf I ] 
LIRRCI 



H.APLACE 

^-LAPLACE 



ERG I 
EMPS 
EIRR 



■LAPLACE VALUES PGR ROI IRR 
LR0ICI1 AND LIRRCI] AND LMP, 
ft SELECT MAX AND MIN 

MAXRoirn^cr/ERoi) 

MAXIRRri1<-<r/EIRR) 

MAXMPS C I J<~ ( I 7 / EMPS 
MINROirn«-( ,/EROI) 

MINIRRTI <-( I /EIRR) 
MINMPSr.I><L/EMPS) 

4(I<TN)/Cl 



AND 

:i;i] 



MP 



r i 



1 MAXROI Ml NRG I MAX IRR MIN IRR MAXMPS MINMPS 1 

MAXRGI AND MI NRG I AND MAXIRR AND MIN IRR AND MAXMPS AND MINMPS 

A 

ft RANK THE INDICATORS 

ft APPLY MAXIMIN CRITERIA 
RANK 1 «- RANK UP MI NRG I 
RANK2<-RANKUP MINMPS 
1 RANK 3 <•• RANK UP MIN IRR 

MATRIXi t-RANK i AND RANK 2 AND RANK 3 
j FINAL 1 <-+-/MATRIX.i 
] FINRANK i t-RANKDN FINALi 

] NO<-tTN 
J ft 

1 RANK4t-RANKUP LRGI 
] RANK5<-RANKUP LMPS 
1 RANKot-RAMKUP LIRR 

j MATRIX2<-RANK4 AND RANKS AND RANK 6 
1 FINAL2<- + /'MATRIX2 
] FINRANK2<-RANKDN FINAL2 

j RANK7<-RANKUP MAXROI 
1 RANK8<-RANKUP MAXMPS 
1 RANK 9 1 " RANK UP MAXIRR 
] MATRIX3<-RANK 7 AND RANKS AND RANK 9 
3 FINAL3<-+/MATRIX3 
1 FINRANKSt-RANKDN FINAL3 
a 

" I 1 

j 'THE FINAL RANKINGS LISTED BY METHOD:' 

] 1 PRO J MAXIMIN LAPLACE MAXIMAX' 

D NO AND FINRANK 1 AND FINRANK 2 AND FINRANK 3 
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vCALIRRCCn 
v Z<-CALlRR X 

II LIMIT*- 0 * 0 i xCOST 
.‘2l EIRft^Ox • 3 

[31 ELIFE<-pX 

[41 CALH)x < lELIFE) 

[51 ' IRR VALUES:' 

!6 IIt-0 

'71 Lirll^II+l 

re jjt-o 

^ Q a Cj « 1 . A 7 

‘1&1 CFS^-XxCFDCin 

III L2 : R*-R+0 . 001 

‘121 JJ<-0 

'131 L3:J.JKJJ-H 

‘141 CAL.CJJl'-CFSI' JJl+< < I +r>*jj> 
151 +( JJ<ELIFE>/L3 

‘161 ANS<- + /CAL 
17‘ G'ALSUM<-ANS-COST 
‘181 UF'F'ERt-CALSUM+L 1MI 7 
'191 LOUIERf-CALSUM-LIMIT 
[201 -* < LGUERiO } a ( UPPER*© > > /L4 

[211 ■> < CALSUM2-0 ) /L2 

[221 R<- ( R-© ,105) 

■73] +\_r> 

[241 L4:EIRR[II>R 
[251 EIRRrill 
[261 -KII<3)/L1 



vCONVERTrDlv 

v Z«-CONVER f X 




COST *• , THESISDC ; 1 1 
INDW)x 1.47 
]>0 

LI : I <- 1 + 1 

INDCIli-Xm-rCOSTCIl 

-KI<47)/L1 



v 




VLAF'L ACE [[]_]'? 
v Z^LAPLACh X 
IMDEXt-oX 
PHr INDEX 
AVG«-+/< VAL^-Xxp 
Z*-AVG 






) 
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1 

o 

3 

4 

5 ] 

6 

7 

8 
9 



Ci i 
1 21 
N 3^ 

i 4 

C153 
i 6] 
Li 7] 
~ i 8~ 
1 9 
20 
21 
99 

23 

24 

25 



^RANKUPrOlv 
? Z<-RANKUP X 

INDEX<-pY 

IH> 

AN5>R<-0x \ p Y 
Li : K-I-M 

I 9 1*. (+1 

ANscJxxm=YCJ]> 

•+ ( JC INDEX > /L2 
DUP<-+/AN£ 

■■* ( DUP > i )/L3 
RCr>ANi’l j 
-K I ( INDEX)/Li 
->L9? 

L3: XX*r/T>+\ANS 
YYmXX 
FH)x\XX 
l<-o 

L 4 :LH _+1 
FCL>T.L 
-* < L.< XX ) /L 4 
RT t-+/F-j-pF 
RCI^RT 
-iilt INDEX) /Li 
L 99 :Z«-R 



'v'DROFTO']'^ 

v Z^-DROP X 
m YM+X 
r 2 3 ZM 4 X 

C 3 “ INDEX*- ( Z^O ) 
[ 4 ] XX-INDEX/Z 
C 5 j ZrY.XX 
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APPENDIX B 



DPPO'S DATA FILE 



This appendix contains the data used to perform the 
analysis . 
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Project Total 
No Cost 



Total Manpower 
Savings Saved 



NPV 



Economic 

Life 



1 


572.5 


25445 


2 


21178.4 


1 5 4 80 0 


3 


5542.2 


130072 


4 


268.0 


6151 


5 


629.9 


16255 


6 


- 1033.8 


5016 


7 


784.2 


2 006 7 


8 


1026.4 


28 29 2 


9 


1711.7 


27 52 9 


10 


468.8 


2 531 


11 


14345.0 


253374 


12 


1894.0 


37600 


13 


788.5 


9198 


14 


240.0 


3828 


15 


2020.0 


65214 


16 


147.7 


149 9 


17 


138.7 


1 873 


18 


126.0 


1757 


19 


245.2 


1 314 


20 


1871.7 


52637 


21 


535.3 


5 863 


22 


476.2 


5 301 


23 


161.6 


1774 


24 


135.0 


10 557 


25 


290.0 


1421 


26 


420.0 


8763 


27 


1351.8 


14 999 


28 


616.9 


21710 


29 


363.9 


2 647 


30 


370.0 


3 43 9 


31 


177.0 


1 48 0 


32 


173 . 1 


1 897 


33 


861.3 


8366 


34 


520 . 0 


12789 


35 


908.0 


7200 


36 


298.7 


2 361 


37 


935.0 


6 700 


38 


199.0 


2460 


39 


635.0 


4 768 


40 


143 . 3 


94 0 


41 


262.0 


12 060 


42 


5931.5 


2 3 26 0 


43 


3182.0 


45950 


44 


870.0 


9 427 


45 


121.0 


672 


46 


105 . 8 


828 


47 


294.9 


4 857 



9.0 


16706.3 


5 


472 . 0 


72663.3 


8 


272 . 0 


33482.7 


25 


4 . 0 


3886.3 


5 


0 . 0 


4247.0 


25 


52 . 6 


2137.9 


7 


0 . 0 


5838.7 


25 


0 . 0 


8311.0 


25 


0 . 0 


8820.0 


20 


38 . 9 


1450.0 


5 


573 . 0 


126215.9 


8 


0 . 0 


19107.9 


10 


7 . 0 


2770.6 


20 


3 . 0 


1241.2 


20 


14 . 5 


39210.2 


6 


5 . 0 


689.6 


10 


0 . 0 


1041 . 7 


10 


0 . 6 


966.2 


8 


5.0 


568.7 


10 


0 . 0 


15621.3 


28 


0 . 0 


3067. 0 


10 


0 . 0 


2876.9 


7 


12 . 0 


1183.7 


5 


0 . 0 


36 97. 8 


25 


16 . 0 


609.8 


7 


0 . 0 


4964.2 


10 


72 . 0 


9803.3 


5 


0 . 0 


7264 .6 


25 


11 . 4 


1217.4 


10 


7 . 6 


1866.2 


8 


3 . 0 


809.9 


8 


1 . 8 


502.5 


25 


13 . 7 


3811.6 


10 


1 . 5 


5964.4 


15 


6 . 0 


3456.7 


8 


18 . 0 


1276. 1 


8 


44 . 4 


3411.6 


8 


2 . 0 


1301 . 9 


1 0 


15 . 0 


2544.4 


8 


3 . 3 


427.0 


8 


0 . 3 


5296.9 


15 


651 . 2 


12142.0 


8 


4 . 0 


21875.3 


10 


13 . 6 


3854.6 


12 


2 . 0 


327 . 1 


8 


2 . 5 


246.6 


20 


2 . 0 


2418.0 


10 



0 

0 

5 

0 

0 

7 

5 

5 

6 

0 

1 

0 

0 

0 

1 

0 

5 

2 

4 

2 

0 

1 

5 

5 

0 

0 

1 

0 

7 

7 

0 

0 

0 

0 

0 

6 

0 

0 

0 

8 

0 

9 

0 

4 

0 

0 

0 
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Cash Inflows (Con't) 
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Cash Inflows (Con*t) 
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Cash Inflows (Con*t) 
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Cash Inflows (Con't) 
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APPENDIX C 



DPPO'S DATA BASE 



This appendix contains the results from the DPPO 
Base case. 
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PROJECT NUMBER:24 
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PROJECT NUM B EB : 27 
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PROJECT NUMBER: 30 
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LAPLACE VALUES FCR R0I I RR AND MPS 
1.2177 0.473 1.1554 
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DPEO Ease Case (Con't) 
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appendix d 



UNCERTAINTY BASE CASE 



This appendix contains the results of the initial 
runs used to determine the impact of uncertainty on DPPO's 
current procedures. 
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RON NUMBER: UNCERTAINTY BASE CASE 
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PROJECT NUMBER: 24 
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PROJECT NUMBER : 27 
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PROJECT NUMBER: 30 
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Uncertainty Base Case (Con’t) 
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APPENDIX E 



SENSITIVITY ANALYSIS RESULTS 

This appendix contains the different computer runs 
performed during sensitivity analysis. Descriptions of 
the runs are noted at the top of each output. 
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BUN NUMEER: COST HIGH - MANPOWER HIGH 
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RUN NUMBER: UNCERTAINTY BASE 
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RUN NUMBER: COST LOW (2) 



CO r- (N O' (J\ O 00 o O O 00 GO O r ~' vO Ov 

o*govold^op-ooo<np-oido>d 4 

xoa^oooinoooror-oc^it 

»•••••••••*•••#• 

Hd'CNmrooinoooifioop'^vo 

JEr-t-iTT- if P -00 



CO^lDhVOOOOOOO^O^rO^ 

^o^^oooooohoo^nvc 
*2 rvj *-r- co o go ooom idoc^co o> 

X I •••*•••••• • 

<v 0 r^t-^ 03 , 00000 \£) 0 d , 0 ^- 

aecMoococN co oovo *-cm*- 



« 

os r- oo ^ oo it oo vo o co ov r** co oo no o 

HooojoocMDooT-^-ooovcooP^itcN 

25 (N(N<NT-<Nr-OOoO<N*-vOvO*-CNit 



SMOOrOOOOOOOOOO^- 



« 

os it oo oo oo id vo co r- p- in o ^ vo *- 

H ^ O ro GO CN o ID CV4 O co O C0 

X p- a> ID P^* VO VO o r- p*» o 00 CMO CO 'X) 

< I « I I I I t I t I I t I I I 

SvOOOOOOO^^Or-OlrOO^ 



vo VO 



vor- *— 

VO 00 o^oo 

• • t • 

oooo 



00 

• • ^ 

COO*~ 

»-)OOrO 

w • • • • 



>r-r-r-r- 



CO 
053: 
35 WWO 
O 

H SSCfri 
HHMpuK 



< cn>ssco 
HO **<**3 
> CJC0EU 
W 

a 



HOOvOCOP^CN^lDCOP-^P^vOP-vODJ 

OCOvOP-i-OOOOitCOP-P-tD^-it*- 

O^rxNCN^-OlDOMDC^vO^T-voa^O 

SS • ( • i i • • • i • • i • • i 

H 00 C4P^P^ 00 r- r- CO 5T ID VO 00 O 

3E»- 



HitOCOCNP^tDlDOO^P^OCNlDO 
O CO 00 ID VO it ID r- tn «- Ov 00 O CNO O 
PS CN CN O (N VO it 00 00 CN r- ID cr» ID VO 

X •• v •••••,»• i ,• • 

#< co t-vo id avp^avcN it co op- it <r» 
3C VO^* 00 00 00 OOitCN CNro^CNit 



SS t- D 4 00 ^ ID vo p- co <J\ O CN 00 it ID 



Q 

O 

a: 

W 



XX 
CQ< 
as 
om 
wx 
Eh** 
co as 
H 

MW 

u 

CO < 

OM 
Z On 

H< 

Ki -4 

55 

<25 
OSH 
ac 

hM M 

< x r-cNiDnor- oor- vo aoooounc CN 

25 < *- «"* r-t— *-T- 



ID iDiDlO ID ID If) ID 

• ••• If! t 

Op-OOrO^GDlDitlDrOCOlD^"CN 



ID ID ID UO 

UOlD t • • • 

• ti-OOCOlDitVOOOOMD^-CN 
-OvOOOr-t— r- t—t— 



ID ID ID 



ID ID 



ID 

t 



On 

n 

W Or-(NOOitlDvor^OOa>Ov-CNOO^*lD 

X 03 r-T-^-^-T-r- 

EH 04 



122 



imnOMno<T'Oooa'(NOr-^ 

av00'»v00 , *0in000in040v0inc3’ 

E(N0>^O^OOO^\£»Or0Of- 

2 • • t i • • » • • i • i • • • 

Hi-inmoo^oooo>coovDCOiD 
co ino4 



wooionooooootnot-rn(N 

04 f-Oi CO 00 010000^0^00400 
Er-OOt-OrOOOOt-COOinm^ 

..it 

rtJoOd’COvoOrnoOOt-vDOt-OO 

Ermn»-m 04 o o> O4co*~ 

1- 1- 04 



« o oc^r* voo4 ^co C0V0O04 

avoincrvovoincovoincNco^avo^* 
H CO 04 04 04 04 ro ro 04 CN VO ^ 04 in 

2 i • • i • i i t i • • i i i i 

H (NOOrOOOOOOOOOO’’ 



a 




a 






CO 






•• 




H 






Q 




a 






O 








a ov CO 04 in 04 ^ 04 04 <T> 04 in o co 


a 




CO 




a vo o in co 04 od 04 co ▼-co in co co 


Eh 




04 




Haa<^*-ocoo*~^^vocr>t— m*“ 


W 




» 






sx 








*4 CM rOh r- •- 0404 *“04 CO r~ 0> 




in in n in in in mining) 


1 




a*- 


Xac 






VO vO 




oQHt-or-fOcn^amcrinroa^^tN 


a 


in»“ r- 




x *- 


*-r- t— 


o 


04 CO CO 


woao4moo40ino4^o404ao^ 


Q**5 




H 


co co co 


O ^ o^voo^ro^vor^vomrot-c'>*-co 


wa 




a 


• # t • 


a co <N oun a in ^ 04 vo ^ p^ i - 04 


Eh 






oooo 


a o o a 04 p- 04 04 ^ vo 04 o 04 in 


a 




m 




H ••••#••••##•#•• 


HW 




o 




*3^f-vpS£)vD»"VOO^^^in( T )d , CD 


>-4U 


in in in in in in in in in in 


a 






*C 




H 






WtJr-oonro^am^inroQO^H'n 


;» 


••vo 




cotv, t- 


t— ▼— ^ T— ▼— 


<2 


coin 




a*: 




CO 


>-4 04 04 


HOOvOOO^vD^O©a>v£)OMn 


Hh-4 






W t • 


o in 04 o> ^ in a co 04 a a r- <n r** a a 


a 




• • 

rr. 


> *“*040404 
pq ia M M M 


aooavomooao>oa<-o4vD04 

x ••«•••••••••••• 


a 




w 


CO 


<p^ovomMr*(Nvoa<oo4coo6aa 


aH 




a 


K5 


Eo^ininvo^vpvoc)^^cr(N^ 


a 


in in in min m 


£ 


a cowo 




h4H 


• • • • • • 


a 


O CO*i-l 




< Xr-o4incor-ar-a^ocoaunoo4 


a 


h ao&* 




a*c ▼- 


T- t—1— ’ T— ^ 




hhh^x 




H = 




a 


co>z;to 




a 




a 


HO-*3*2<J 


0 ▼- 04 a ^ in a r- a ovo ^ O4co m 






a 


> ucoaU 


a 


w 0 04 co in vo r* a o> 0 ▼- 04 co cr in 




w 




aa 






Q 




EH 





123 



cnc^cj-r^oc'ooo^^ooco*- 
Ot m cd oo & o cm o o o cm f- o co r* r* 
asvoauncoocMooor*coor-^m 
a •••••••••••••• • 

Hin^f^tnocooooo^a’Orod’CN 

an ^ r- CM*— 



WrvOhOOOOOOOCnOhhr 
P^vo*— cooo^ooo^uoocovot^ 
x:o^^ovocoooovocmocovouo 



<3 o oun ( J \ o p-* o o o o co o r- VO cr> 
x:cmcmvo*- vo *-uo *- v - 



as 

o 



H 

CO 

o 

U 



03 

w 

CQ 
J C 

o 



2 ? 

O 

03 



• •CM 

tn*- 

Men *- 

1X4 * • 

> CM CM t— CM 



hJ tO 

OS SB 

towo 

CJ»h 4 
250 &* 
EhHH^K 
C tOfi> 25 CO 
H O ** *<**3 

> ucoanCJ 
w 

Q 



03 o r* r- vo cn ^ co ^ co vo o <N 

03 vo in & vo vo cD co vo tn cm co ^ co vo 

HCO(NCMCMCMr-COCOCMCMr^vO*-CMUO 

a i i • i i t i t i « t i i i i 

HfNOOrOOOOOOOOOO’- 

x: 



25 

o 



HOOvoocr\^rvo^ocDcnvocnr-in 
O ID CM cn ^ in vo co CM ^ <x> r - cm r- vo vo 
03 r* co vo in r* o co o co *- cm vo cm 
X • • • • t • • # • • • • • t • 
C r* r* vo ID CM r- CM vo CO CO CM co CO CO CO 

as o tn tn vo vo vo co r- ^ ^ cm co r- 



O^CMco^tnvor-cocnOf-CMm^Ln 



a 

o 

as 



tn 

25 




03 O' OV CO CM UO CM f* & CM CM C' CM UO O 
03 VO o UO CO ^ CO CM CO ^ CO UO CO co 

h co co ocoo^ *— vo O' *-uo *— 


EH 

w 

as x 

«*3 


H 


vo vO 


^CMi-Or-^^CgCM^-CM^CO*-*-^ 


xx: 


> 

*a 

tn 


U0*~ *- 

CM CO CO 

cocoo^co 

t • • • 


x:^ 

w*-oo*-r-uouoor-*-vovovoc*\uor- 


OQH 

X 

Q**3 

H£ 


l 

s 


oooo 


O P^ & co OWO OCO CO CO CM O CV UO *- 
03 VO vo CT> CM O ^ h- co CM CO CM co o vo 
Z CO O' O O ^ VO CO vo f- co vo UO f- CM 


eh 

tn 

HW 


o 

H 




H«t**t**i«ti*ti* 

aCUOOrOCOCOOCOCOCMoCMCM^CM^ 


hMCJ 

<3 



tntn 

UO UO UOUO UOUO UOUO • • 
-Oh • •••••# •c 3 '^-CM 

*— coco*-aouO; 3 'UOcoco*-*- 



id uouououotnuouotnuo 

• •«••••••• 

-or^enro*— couo.=rtnroaocr*-CM 



CD <-m 
25 *3 
HhJ 
*3 
25 

<25 
03 H 

as 

i-JH 

*:x< 

25*5 

H« 

tu 



w O *-cm co^* tn vo r* co ov o *- cm co ^ tn 

3325 

H 



UOUO 



tn 



UOUO UO 

• I I • t t 

- cm uo co r* co r- vo <3* o co OMn o cm 



124 



{^mQDiDvoocNOOornoornorn 

Emmcoroo^ooocNroocro^ 

a ••• t • 

HM^MOCDOOOrnvOO^^ 
E *- 



io^\£)^oooooo^ohh^ 

i^vD^rnoocfOOocrinorovDr 

Ea>r*^cnoaoooo^(NOcovOLn 

• 

rtjooMn^oroooorno»-voo% 
E<NCN\0<- VO <“in W- 



a o r- r- vd cn ao ^ go vo o <n 
asvomctiOvomrniomcNrncraoiOt- 
h m <n <n r^i <n rn m <n cm vo (n un 

»•••••••*••••*•• 

HCNOot"OOOOOOOOOOf- 

e 



o 




03 av a> m cm to cn p*. ^ <n cm <j\ cm in o m 


O 

33 


H 




03 VO O CD ao P** CM GO CM P0 r- CO in GO CO 


H 


cn 




MoDaDavt-oroo*-^rt-vo a ''t-in*- 


pq x 

E«< in mmmminmmmm 


CM 




< cn *-op* r- 1- cNCNr-cNcr m 




E 


VO VO 


E*“* 


X h t- o p^ co ro ao in ^nn ro ao cn 


1 


iTIr- r- 

(Nro m 




CQX t- t-r- *— t-r- 

c 




aonnCNro 


H o ao cm in o cn o in cm zt cm cn go o zt 


QE 


33 


• • « • 


O ^o^voavm^voP^voiDm<“av<-m 


W 


U 


oooo 


ccmcNaun^— counr-^rcNvo^rp ^^— cm 


E-» 


H 




e r- av ^-o co cn r - cm cm cr vo cno<n tn 


tn w 


33 




H • •••••••••••#•■ 


hu in mmmminmmmm 




t-’r-f’*— 


e t- 1 - \p vo vo vo r* =* cr to cn z* co 


h3 C • «•••••••• 


CO 




r- 


H^or-ropn^aDin^MnmcDcrr-(N 


O 

a 


• •VO 




C0 04 r- t- 

o< 


M 


COLO 




55H 


> 


HCN r- 


h o o vo o o*» zt vo o co av vo av p^ in 


H 


< 


W • • 


omcNo^^mvomcNovco*— ( np^vovo 


« 


CO 


5>^(Mt-(M 


03 P 1 ^ P“ GO VO in P^ O CD CTV o ao t- CM VO CM 


25 









ca 


• • 


H 10 


-Jj r- r- vo in CN ^ CN VO CD P0 CN GO ao CD GO 


03 H 


03 


033 


e o *- in in vo *- vo vo cn c* zt cn m r- 


e in in in mm m 


W 


25 tOWO 


*■* 


HH • • • • • • 


04 


O 0:»H 




c x*-cNmcop^cor*vo^ocoa>mocN 


E 


H 5500* 




55 C i— r- r-r- *— *— 


n 


HHHCLiE 




HE 




CCO>EtO 




Cm 


a 


HOC<!C 

XJCOEU 


O *- cn ro cr in vo ao O' o cn co cr in 

55 t-T-i-t-i-i- 


w o^cNmctmvor-cD^Ot— (Nm^m 


33 


W 




33 525 v-i-i-v-T-v- 


« 


Q 




H 



125 



invo^mnooooooinnoococNin 

Wf ^r-000*“000v000v0tnf 
Etnr-oaootnooooaoooor- 
zcNr^av*-o©ooovOf or-o>in 
(-(•••••••#••••••• 

ErrrorQ^OOOWOOOO 



^t-OhOOOOOOOC^Ohhf- 

w vo *- m o o cr o o o ^in o no vo r* 

E(^r^^O>OQOOOO'X5(NOOOvDLn 

X • 

^oo^in^o^oooomoi-vo^ 
SCNCNlOf VO fin ff 



zoot^r^r-r-vocNcrao^aovoocN 

«vom^vovoinnovotncNnoc*aovo^- 

HnOCNCNCNCNf nOnOCNCNr-iO*-CNtn 

Z • •••••••••••••• 

HCNOOrOOOOOOOOOOr 



05 rr no no no m vo oo r- r* in o z* vo f 
H f o ono oo cn o rsiav ao o^n 

x r^oMnr-vovoOf r-onooMnaovo 

<C * • t •• t *•••••• t • 



Q 

O 

3= 

EH 

W 

X3 X 



in inmin tnintn in 





vO VO 


ElDOOnOO^i-OrCNt-OO^ 


fcHE • • • 


• • • 


• t 




tn<— f 




co Hi— or^nono*— aoin^mnoaom^"CN 




CNno no 




X t- f f 


*— 


^f 




oo no cn no 




0-5 








• • • • 


H o ao cs in O CN O in CNI ^ CN CN 00 O 


w ac 






o 


oooo 


O^c^vocr>o 0 f vor^vomnof <^f no 


£H 






t-3 




a: no cnov in *- oo in zr cn vo ^ r* f cn 


cn 










z r* o> o oo cn r* cn cn cr vo cn © cn in 


H w 






03 


f l f 1 < 




H u intnin 


in in 


in 


W 




S3 1 -' vo VO VO T- vo r* ^ f ^ in no zt 00 


-5 • • • 


• • 


• 


* 




f 


cn or- ovonof noaomc*vonocMn*-CN 


o 


• •vO^T O' 




OH f f ^ 


f 


^f 


04 


cntm- ^ 




35 -C 








i-lCMO«rO 




HO 






«S 


W * » • » 


h r* no vo av oo cn o oo tn <r> o ao ^ o 


*5 






sc 


>► r f 


o cn ao zt o f vo m ao vo no o o no o oo 


Z 











05 vo cv ao cn ov ct ao vo p*^ no vo vo 


■< Z 






•• 


i-5 cn 




05 H 






05 


CCZ 


z* ao ao ao f in *- no av vo z* z* o o 


a: tntn in 


intn 


in 


W 


z cn wo 


sin cncnoo no no*— <NCNf i— no 


OH • • t 


• • 


• 


CO 


o 




-5 x^’CNinnor^nor^voiTonoaMnocN 


E 


H PS O W 




Z -5 f f 


f f 


f f 


O 


engHHcuac 




H* 






Z 


id3Cn>25Cn 




W 








HO^CC 


O^CNnoznnvor^aoavOt— cNro^rtn 








z 


>UV)EU 


55 f-p i 


w Of CNno in vor^ oooo f CNno ^-tn 


3 


W 




X z 


f f 


f f f f 


05 


Q 




H 







126 



cmno r- in ocn o oo cn <no rn 

Qla VOf^ VO 0*010 OO OLD CNO VO<D it 

is CN<T> f-vo o^t o oo ct vo o cocr> «- 

55 • • i • i i • • • • • • • • i 

m ^inmoo^oooc^coo^coLn 
St-r-fOr- m lOCN 



cn coin ooo © ooo ^ oao ooo 

c^cNooi^cNOQOooor-^or^or- 

13 «•••••••••••••• 

X h*CN 00 * 000000 '' (T>OCOlDi- 

•< in cn O' it o cno* cocNh- 

an*— cNct*— in com *— 



33 




O 




H 




as 




cn 




cu 




S3 




% 




cn 




CP 




55 


VO VO 


H 


r- f— 


> 


ro m 


< 


cNmovm 


cn 


# • # • 




oooo 


i 




* 


f r-f-r- 


o 




rJ 


t*vO 


EH 


COD 


cn 


h4CN CN 


O 


W • • 


CJ 


>i- CNCNCN 

M -- mm •• • ■ 




►-3 cn 


03 


03* 


W 


z enwo 


04 


O CP*h4 


13 


H JZO&4 


3 


EHHHCUaC 


53 


»*£ to >55 cn 
HO<><< 


55 


xjenasu 


O 


w 


03 


Q 



ct3 o r- r^* vo cm zr oo ^ co vo o cn 

PSlOlOitlOlOincOVOinCNrO^GOlO*-- 
H m <N (N CN CN f- m on <N CN r^* VO «— CN ID 

»••••••••••••••• 

H(NOO r OOOOOOOOOOr 

13 



03 a*O*r0CNinCN[^ :fCNCNO*(NinOrO 

« ^odco i-r - <n co cnco f- m toco m 

MCOCOCJN^Omo^^^vOO^T-DT- 
X •••••••••••• t • • 

*C CN or <N CN r* CN & CO f— ^ O' 



HOQOCNlDOCNOLnCNcTCNCMGOOzr 

O ^0'voo>co^voP‘*vocnco^O' f ~ro 
P5 m cn o> in i- co in r* it <n vo it r* «- cn 
Z r- a> f- o CO CN D- <N CN C3* vo cm o fN d 
H ♦ •••##•••••••#• 

ac i— vovovo^vor^^y ^—zyDro^co 



HOOOOOt^OOOa^OOOOO 
oin^^«-\ocNOLnmcorncNLno^ 
03 5T O VO LO O LO ^ VO CO CT» VO D vo D CD 

X •••••••••••#••• 

*< ^ co it on co co in in o m vo co vo a* cn 
as it r* mcN id it in r** vo id r* o* *- in cn 

it CNCNCN CNCNf- 



O «— CN CO it tD VO r* CO 0*0 CN m it lo 

55 T— T— T— 



Q 

o 

as 

Eh 

w 

S3 X 
•< 
xac 

CQH 

X 

QC 

ws 

Eh 

cn 

H W 

CO 1-4 
OU 4 

H4 

u: 

•<25 
03 H 
13 
)4H 

-ex 

55 C 
H *3 
PM 



ID DLODlDDCODlDD 

t •••••••#• 

Of^ m C0 1 - COD iTlD COGO it 1 -CN 



ID DDDDDlDDDD 
•Oh • •*••»••#• 

*- com*-coinitincocDit*-cN 



in id in 



in in 



ID 

t 



•CNl/)mhCOhV£)^OnCMDO(N 



Wo , "Csjnd'Ln\OhQO^Ot-cNcninn 
qnss f-f-f-f-t-t- 

Eh 



127 



LIST OF REFERENCES 



1. Air Force Management Engineering Agency, UNCLASSIFIED, 
to Headquarters, United States Air Force/MPMZ, Subject: 
Fast-Payback Capital Investment (FASCAP) Internal Audit, 

22 April 1981. 

2. Anthony, Robert N. and James S. Reece, Accounting, Text 
and Cases , Irwin, 1979. 

3. Baumol, William J., Economic Theory and Operations 
Analysis , Prentice-Hall, 1977. 

4. Clark, John J., Hindelang, Thomas J., and R.E. Pritchard, 
Capital Budgeting , Prentice-Hall, 1979. 

5. Department of Defense Directive 5010.31, "DoD Produc- 
tivity Program," 27 April 1979. 

6. Department of Defense Instruction 5010.34, "Productivity 
Enhancement, Measurement, and Evaluation — Operating 
Guidelines and Reporting Instructions," 4 August 1975. 

7. Department of Defense Instruction 5010.36, "Productivity 
Enhancing Capital Investments," 31 December 1980. 

8. Fishburn, Peter C., Decision and Value Theory , Wiley, 1964. 

9. Halter, Albert N., and Gerald W. Dean, Decisions Under 
Uncertainty , South-Western , 1971. 

10. Luce, R.O., and H. Raiffa, Games and Decisions, Wiley, 

1957. 

11. Mooney, Paul E., Decision Making , McGraw-Hill, 1983. 

12. Morris, William T., The Analysis of Management Decisions , 
Irwin, 1967. 

13. Raiffa, Howard, Decision Analysis , Addison-Wesley , 1970. 

14. Savage, L.J., The Foundations of Statistics , Wiley, 1954. 

15. Whipple, David, and Jack LaPatra, An Evaluation of the 
Defense Productivity Program Office Activities and 
Organization , January 1983. 



128 



INITIAL DISTRIBUTION LIST 



No 



1. Defense Technical Information Center 
Cameron Station 

Alexandria, Virginia 22314 

2. Library, Code 0142 
Naval Postgraduate School 
Monterey, California 93943 

3. Associate Professor David R. Whipple 
Code 54Wp 

Department of Administrative Sciences 
Naval Postgraduate School 
Monterey, California 93943 

4. Assistant Professor D.C. Boger 
Code 54Bk 

Department of Administrative Sciences 
Naval Postgraduate School 
Monterey, California 93943 

5. Associate Professor G.F. Lindsay 
Code 55Ls 

Department of Operations Research 
Naval Posgraduate School 
Monterey, California 93943 

6. Defense Productivity Program Office 
5203 Leesburg Pike 

2 Skyline Place, Room 1401 
Falls Church, Virginia 22041 

7. LCDR Edward A. Lenio 
Rt 1, Box 382 

Oak Ridge, North Carolina 27310 



‘■Tv 

A 

n 

a 



\ 

\ 



Copies 

2 

2 

10 

2 

1 

5 

5 



129 






thesis 

T*L5l66 

Ljc.l 



207139 



The introduction 0 - 

tS C th tainty techn ique 
t the Productivity i 
vestment fund. 7 



5 JUN $ 6 

13 KAr 



207139 



Thesis 

L5166 Lenio 

c.l The introduction of 

uncertainty techniques 
to the productivity in- 
vestment fund. 







